Privacy Mode for a Wireless Audio Device

ABSTRACT

Devices that record data from a space, such as audio or video devices having microphones and/or cameras, may have a privacy mode which allows a user to temporarily prevent the device from recoding audio or video of the space. The privacy mode may be a privacy cover, button, airgap, or other mechanism to obfuscate the acoustic or video signal, or to remove power and/or communication from the camera, microphone, control circuit, or to the entire device itself. Additionally, the privacy mode may be remotely enabled for multiple devices in a space.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/221,400, filed Dec. 14, 2018, which claims priority to ProvisionalU.S. Patent Application No. 62/598,792, filed Dec. 14, 2017, the entiredisclosure of which is incorporated by reference herein.

BACKGROUND

Voice integration devices, for example, voice assistants such as AmazonEcho or Google Home devices may allow a user to vocally interact with aconnected microphone/speaker device. Voice integration devices may alsobe used to control other devices in a home or business setting throughthe use of a keyword. For example, a user can integrate a voiceintegration device (e.g., Amazon Echo) with a smart home network tocontrol the lights through a keyword or wake word (e.g., “Alexa”)followed by a user command (e.g., “turn on the living room light”).

Voice integration devices may be connected via a network to a remoteserver which may perform voice recognition on the acoustic data of theuser command in order to interpret the command, and may thereafterprocess the user command. The voice integration device may transmitacoustic data to the remote server upon receiving the keyword. Thenetwork connection between the remote server and the voice integrationdevice may include an Internet router, and may be a wireless or wiredconnection. For example, the network connection may be a Wi-Fi orEthernet connection to an Internet router. After the remote server hasinterpreted the acoustic data, the remote server may instruct a systemcontroller device, such as a hub device, which may then transmit devicecommands to other devices based on the interpretation of the acousticdata. The voice integration device may respond verbally to the user toprovide acknowledgement that the user command was received and/orrespond with information requested by the user in the user command.

While voice integration devices may provide convenience to a user, auser may also desire the ability to put the device into a privacy mode,i.e., to disable the device. Voice integration devices may have a mutebutton for putting the device in a privacy mode, the button muting thespeaker. When the mute button is activated, an LED indicator may turn onto indicate to the user that the device is muted. However, the voiceintegration device may continue “listening” to the audio traffic of theroom while the mute button is activated, and the device may even storeacoustic data locally. That is, the voice integration device maycontinue to monitor acoustic data in the space and record the data in atransmission buffer stored in memory of the device, even while thedevice is in a mute or privacy mode, but not transmit the acoustic dataonto a network/to a cloud service for processing. Additionally, thedevice may be susceptible to malicious software updates from theInternet, for example, which may override the mute button and allow thedevice to continue transmitting acoustic data to the Internet when thedevice appears to the user to be in a mute or privacy mode (i.e., whenthe LED indicator appears in a mute mode). For example, the device maybe actively listening while the LED indicator is on. To provideconfidence that the device is in an inactive mode, a user may need tophysically unplug or remove power from the device or disconnect thedevice from the network. This may be inconvenient and may also requirethe user to wait to use the device when the device goes through astartup sequence after power is applied. Another issue is that if a roomhas multiple voice integration devices, a user may need to activate themute button on each device. Therefore, there is a need for a privacymode for audio devices which gives a user full confidence that thedevice is no longer listening and that is not susceptible to malwareattacks, as well as a mechanism for simultaneously placing multipledevices into privacy mode.

SUMMARY

Described herein is a privacy mode for a voice integration or audiodevice that is tamper-proof, i.e., not able to be compromised bymalicious software. An audio device may be any device that has amicrophone and can transmit acoustic data. The privacy mode may includemechanically muting or covering up the microphone of the audio device,providing a physical disconnect, or adding interference to obfuscate theaudio signal. The physical disconnect may be an airgap or multipleairgaps which mechanically disconnect an electrical or opto-electronicconnection, removing power and/or communication to the audio device orto the microphone of the audio device to fully disable the microphone(s)audio processing capabilities. The interference may be an acousticinterference or may be electrical noise added to the audio data of theaudio device. According to another embodiment of the invention, theprivacy mode may be a software enable or disable mechanism with ahardwired indicator, such as a light-emitting diode (LED) indicator,wherein the state of the LED indicator is tied to the state of themicrophone and not separately controllable by a control circuit.

Additional embodiments as discussed herein include a remote-activatedprivacy mode, or “Privacy Mode” as a scene, which allows for multipledevices to enter privacy mode through the activation of a singularcontrol point. This remote-activated privacy mode may be triggeredautomatically based on specific triggers, including, but not limited to:occupancy, user preference, or particular activity or voice commands ofa user, as will be described in more detail herein.

One skilled in the art will also understand that the embodimentsdescribed herein are not mutually exclusive and may readily be combinedwith each other.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an example room with various wireless devices that may beresponsive to a privacy mode setting.

FIG. 2 is an example audio device with a privacy cover.

FIG. 3 is another example audio device with a privacy cover.

FIG. 4 is a block diagram of an example audio device according to FIGS.2, 3 .

FIG. 5 is an example audio device with a privacy button.

FIG. 6 is an example diagram of a true privacy indicator for an audiodevice.

FIG. 7 is an example audio device with a mechanical disconnect forprivacy.

FIG. 8A is a block diagram of the example audio device of FIG. 7 withmechanical disconnects for privacy.

FIG. 8B is a block diagram of an example audio device with a secondcontrol circuit for introducing noise into the acoustic signal.

FIG. 9 is an example audio device that has a remotely resettablemechanical disconnect for privacy.

FIG. 10 is an example audio device that is also a load control device.

FIG. 11 is a block diagram of the audio device of FIG. 10 that is also aload control device.

FIG. 12 is an example privacy mode selection on a mobile device.

FIG. 13 is an example flowchart of a method for controlling a circuit toenter or exit a privacy mode.

DETAILED DESCRIPTION

This application is directed towards a high-confidence tamper-proofprivacy mode for audio devices. The privacy mode may be tamper-proof inthat the privacy mode is not able to be compromised by malicioussoftware, for example, by providing a visual indication tied to thehardware that may allow a user to confidently determine whether privacymode has truly been enabled.

FIG. 1 is an example user environment 100 containing various devices.The user environment 100 may include a load control device 104. Forexample, the load control device 104 may be a wall-mounted light switchor dimmer which is electrically connected to the lights 110A, 110B forcontrolling the lights 110A, 110B. Examples of wall-mounted dimmerswitches are described in greater detail in U.S. Pat. No. 5,248,919,issued Sep. 29, 1993, entitled LIGHTING CONTROL DEVICE, and U.S. Pat.No. 9,679,696, issued Jun. 13, 2017, entitled WIRELESS LOAD CONTROLDEVICE, the entire disclosures of which are hereby incorporated byreference.

The user environment 100 may include a keypad 106. The keypad 106 mayinclude one or more buttons for controlling lights, such as lights 110A,110B, motorized window treatments, heating ventilation and airconditioning (HVAC) systems, etc. For example, the keypad 106 may havepreset scenes associated with each of the one or more buttons, whereinactuation of the preset scene button may control the lights, windowtreatments, etc. to a predetermined level. Further, for example, theprivacy mode may be enabled as part of a preset scene which may beselected by a user actuation of a button on the keypad 106.

The user environment 100 may include a security camera 122. The securitycamera 122 may be mounted to a ceiling or wall of the user environment100, for example, and may record images of the user environment.Alternatively, the security camera 122 may be a standalone device, suchas a webcam, which may be placed on a table and plugged into anelectrical outlet or USB power connection, etc.

The user environment 100 may include a video intercom 120. The videointercom may record images and audio of the user environment andtransmit the images and audio data to a remote device, such as anothervideo intercom, a tablet, a PC, etc.

The user environment 100 may include a hub device 129 (e.g., a bridge)configured to enable communication with a network 130, e.g., a wirelessor wired local area network (LAN). The hub device 129 may be connectedto a router 127 via a wired digital communication link (e.g., anEthernet communication link). The router may allow for communicationwith the network 130, e.g., for access to the Internet. Alternatively,the hub device 129 may be wirelessly connected to the network 130, e.g.,using Wi-Fi technology. An example of the hub device 129 is described ingreater detail in commonly-assigned U.S. Patent Application PublicationNo. 2014/0052783, published Feb. 20, 2014, entitled WIRELESS BRIDGE FORFACILITATING COMMUNICATION BETWEEN DIFFERENT NETWORK, and U.S. Pat. No.9,851,735, issued Dec. 26, 2017, entitled WIRELESS LOAD CONTROL SYSTEM,the entire disclosures of which are hereby incorporated by reference.Other examples are possible.

The hub device 129 may be configured to transmit RF signals 108 to theload control device 104 and/or the keypad 106 (e.g., using theproprietary protocol) for controlling the respective lighting loads110A, 110B in response to digital messages received from externaldevices via the network 130. The hub 129 may be configured to receive RFsignals 108 from the load control device 104 and/or the keypad 106, andto transmit digital messages via the network 130 for providing data(e.g., status information) to external devices. The hub device 129 mayoperate as a central controller for a load control system of the userenvironment 100, or may simply relay digital messages between thedevices of the load control system and the network 130.

The user environment 100 may include a voice integration device, whichmay be described more broadly as an audio device. The audio device mayhave at least one microphone. The audio device may further have at leastone speaker, either integrated with the audio device, or an externalspeaker to which the audio device transmits acoustic signals forplayback in the space.

The audio device may be integrated into any of the devices shown in theuser environment 100. For example, the audio device may be integratedwith the load control device 104. Although the examples provided hereindescribe integrating the audio device with a load control device, oneskilled in the art will understand that these embodiments are notlimited to load control devices, but alternatively, or additionally, theaudio device may be integrated with keypad 106, lighting loads 110A,110B, security camera 122, and/or intercom 120, etc. Or, the audiodevice may be a standalone device, such as a wall-mounted audio deviceor a plug-in table top audio device, shown here as audio device 125.

The audio device may detect voice commands from a user 102 and maytransmit acoustic data based on the voice commands to a remote server140, such as a cloud based server, on the Internet 130 for acousticprocessing. The audio device may transmit acoustic data to the remoteserver 140 on the Internet 130 via a wireless or wired connection to arouter 127. For example, the connection may be through Wi-Fi orEthernet. The router may receive the acoustic data from the audio deviceand transmit the acoustic data to the remote server 140 on the Internet130.

The audio device may have a mute or privacy mode. The mute or privacymode, when enabled by a user 102, may cause the device to stoptransmitting acoustic data to the router 127. The audio device mayprovide a visual indication that the device is in a mute or privacymode. For example, the audio device may have an LED indicator that turnson or changes color when the device is in the mute or privacy mode.Additionally, or alternatively, other indications may be used, forexample, an indication on a mobile application may alert a user that theaudio device is in the privacy mode.

The audio device may process the acoustic data and control other deviceswithin the user environment 100 based on the processed acoustic data.For example, the audio device may enable a user to vocally control thelights 110A or 110B.

The user environment 100 may include additional devices which mayreceive audio and/or video inputs to monitor the space. Any or all ofthe devices may contain a microphone and/or a camera. Additionally, anyor all of the devices may transmit data based on the received audio andvideo inputs monitored in the space. For example, the user environmentmay have a security camera 122, a video intercom 120, or microphonesembedded in the load control device 104, or the keypad 106. The devicesmay transmit data to the router 127 for processing by a remote server onthe Internet 130. The remote server may be the same server or adifferent server than the server 140 used to process the voice commandsby the audio device 125. Although the devices are described herein asusing a remote server 140 for voice processing, one skilled in the artwill readily understand that voice processing may alternatively beachieved through processing local to the device.

The devices may transmit data directly to the router 127 via a wired orwireless connection. For example, the connection may be a Wi-Ficonnection 109. Or, the connection may be a wired Ethernet connection.Alternatively, the devices may transmit data via a different wirelessprotocol 108 to an intermediary device, such as hub device 129, whichtranslates the data and sends it to the router 127. For example, thedevices may use a standard wireless protocol (e.g., ZigBee, Wi-Fi,Z-Wave, Bluetooth, Li-Fi, etc.), or a proprietary protocol (e.g., theClearConnect protocol).

The user 102 may control any of the devices in the room through voicecommands and/or wireless commands. For example, the user may press abutton to send a wireless command to control one or more devices in theuser environment. The button may be a physical actuator, such as abutton on load control device 104 or keypad 106, or the button may be asoftware button on a graphical user interface (GUI) of a mobileapplication. For example, the user may press a software button on a GUIof a mobile application installed on a mobile device 115. The mobiledevice 115 may transmit a command to control one or more of the devicesin the user environment in response to receiving the button press.

Each of the audio devices, for example devices 104, 106, and 125, mayinclude a privacy mode. Although the privacy modes are described foraudio devices, one will understand that the embodiments described hereinare not limited to audio devices, and that privacy modes may also berealized for other types of devices which record sensitive data in thespace. For example, the security camera 122 and/or the video intercom120 may have privacy modes as described herein.

The privacy mode may prevent the device from transmitting data (such asaudio or video data) from the user environment 100 to the router 127,the hub 129, or to any other device(s) within the room. For example, theprivacy mode may prevent the device from transmitting data bydisconnecting power and/or communication to a microphone or cameracircuit thereby disabling output of the data.

As will be discussed in greater detail herein, the privacy mode for eachdevice may be a device-level privacy mode and/or may be a remote privacymode. A device-level privacy mode may require a user 102 to physicallyinteract with a device to place the device into privacy mode. Forexample, a user may physically press a button on the device. In analternative example, a user may engage or disengage a mechanism local tothe device to put the device in a privacy mode. The device-level privacymode may require a user to physically approach the device to engage orenable the privacy mode; that is, the device-level privacy mode mayrequire a manual user input, as will be discussed in greater detailherein.

Alternatively, the user may remotely enable the privacy mode (i.e.,remote privacy mode). A user may put the device or multiple devices intoremote privacy mode when the user is not located proximate the device ordevices, i.e., the user may enable privacy mode remotely withoutphysically interacting with the device. For example, the user may enableprivacy mode remotely through a mobile application on a mobile device,such as mobile device 115, or through a privacy button, such as a buttonon keypad 106. These and other embodiments will be discussed in greaterdetail herein.

As described, other devices such as the security camera 122 and/or thevideo intercom 120 may also have a privacy mode. When the securitycamera and/or video intercom is placed in the privacy mode, the securitycamera and/or video intercom may stop transmitting video feed updates tothe hub device 129, router 127, or any other devices capable of usingthe video feed.

FIG. 2 is an example of an audio device 200 with a device-level privacymode. The audio device 200 may be configured to be mounted in anelectrical wallbox. For example, audio device 200 may include yoke 201having one or more holes 203 therein, and a user interface/front surface207. Screws, for example, may be inserted through holes 203 to secureaudio device 200 to an electrical wallbox. Thereafter, a faceplatehaving an opening therein may be placed over audio device 200, coveringyoke 201, and with user interface 207 extending through the opening inthe faceplate. As one example, the faceplate may be a standard“off-the-shelf” faceplate such that the opening defines a standardopening. For example, the faceplate may be a decorator-style faceplatedefining a standard-sized opening. Here, user interface 207 of audiodevice 200 may be dimensioned to fit within such an opening of thefaceplate. One will recognize that other configurations are possible.

The audio device 200 may contain at least one microphone (not shown inFIG. 2 ) for monitoring acoustic data in the space in which it isinstalled. The audio device 200 may also include at least one speaker(not shown in FIG. 2 ).

The user interface 207 of device 200 may include a protective cover 210.The microphone and speaker may be located within device 200 and behindthe protective cover 210. The protective cover 210 may serve to protectthe microphone and/or speaker from damage, dust and debris. Theprotective cover 210 may be configured such that acoustic dataoriginating in the space may be received by the microphone in a largelyunaltered state. Similarly, the protective cover 210 may be configuredsuch that acoustic data originating from the speaker may pass throughthe cover in a largely unaltered state. As an example, the protectivecover 210 may be a grill, grate, mesh, perforated surface, cavity, orfabric although other types of covers may be used.

One will recognize that while the microphone and speaker may both belocated behind the protective cover 210, according to another example,the microphone may be situated at another location on device 200. Forexample, audio device 200 may include one or more light emitting diodes(LEDs) (although other lighting elements may be used), such as indicatorLED 205 and indicator LEDs 206. User interface 207 may include openingsor cavities therein through which light emitted by respective LEDs 205and 206 may be visible. The speaker may be located behind protectivecover 210, while the microphone may be located behind a cavity orcavities of LED 205 and/or LEDs 206. Other examples are possible.

The audio device 200 may also have a volume adjuster that is accessiblefrom user interface 207 for manually adjusting the output volume of thespeaker of the device. As an example, the volume adjuster, as shownhere, may be two volume buttons, a volume up button 202 and a volumedown button 204. Alternatively, the volume adjuster may be a rotatingknob, a capacitive or resistive touch area, or any other suitable volumeadjustment. A user may press volume button 202 or 204 to increase ordecrease the volume level, respectively. The volume adjuster may adjustthe volume of the speaker by increasing or decreasing the amplitude ofthe speaker output.

As indicated, the audio device 200 may additionally include one or moreLEDs, such as indicator LED 205 and indicator LEDs 206, which mayinclude an array of seven LEDs according to this example. The indicatorLEDs 206 may turn on to indicate the volume level of the speaker of theaudio device 200. For example, the bottom four LEDs of the sevenindicator LEDs 206 may turn on to indicate an approximate volume levelof sixty percent of maximum volume. The LEDs may be in a linear array,as shown, or they may be arranged in a horizontal fashion. Althoughseven LEDs are shown here in indicator LEDs 206, any number of LEDs maybe used, either located discretely in a linear array or as a band orline of LEDs (i.e., sharing a common lens). Alternatively, the LEDs 206may be integrated into the volume adjuster 202 and/or 204. As anotherexample, the LEDs 206 may be integrated into a rotating knob, or acapacitive or resistive touch area if such devices are used as thevolume adjuster. One will recognize that other mechanisms may be used toindicated to a user the output volume of device 200.

Audio device 200 may include a mechanism to cover up, or muffle, themicrophone. For example, the audio device 200 may contain a privacycover 208. The privacy cover 208 may be a sliding cover. The privacycover 208 may slide along direction L in one or more tracks 220 locatedalong the vertical sides of protective cover 210 to either expose orcover the protective cover 210 and thus the microphone. For example, auser may physically slide the privacy cover 208 upward along direction Lto cover the protective cover 210 (and microphone) and thereby engagethe privacy mode, and may physically slide the privacy cover 208downward along direction L to uncover the protective cover 210 (andmicrophone) to disengage the privacy mode. The privacy cover 208, whenengaged, may reduce the sound pressure level (SPL) incident on themicrophone such that speech in proximity to the device may not bediscernable, i.e., to physically muffle the sound input received by themicrophone. One will recognize that if the microphone is located behinda cavity of the LED 205 as previously mentioned, the privacy cover 208may further cover the cavity of the LED 205 in order to mute or mufflethe microphone.

The privacy cover 208 may be made of a material(s) to sufficientlymuffle the microphone such that audio received (if any) by themicrophone of device 200 and subsequently interpreted by a processor maynot be interpretable into words or the source of the audio, etc. Forexample, the privacy cover 208 may be made of a rigid material such asmetal or plastic, or the privacy cover 208 may be made of a softmaterial such as speaker fabric. The privacy cover 208 may havesilicone, foam, and/or other suitable sound dampening material on theback surface thereof that faces protective cover 210 when the privacycover 210 is engaged in privacy mode. Such materials may be used tocreate a more effective acoustic seal around the protective cover 210,and thus the microphone.

To enable or engage this privacy mode, a user may physically slide theprivacy cover 208 upward over the protective cover 210, and therebycover the microphone. Therefore, the privacy mode of device 200 may notbe disabled remotely from the device, that is, the privacy mode may notbe compromised through malicious software as the user has a means ofmanual override. One will understand that the amount of reduction in SPLincident on the microphone when the privacy cover 208 is seated over theprotective cover 210/microphone is dependent upon the mechanicalconstruction of the microphone housing, protective cover 210, and/orprivacy cover. Therefore, different privacy covers may affect the amountof sound reduction. One will also recognize that different mechanicalmechanisms besides sliding a privacy cover over the microphone may beused, provided that the microphone is covered or muffled. For example,the privacy cover may be snapped on, or the privacy cover may be rotatedinto place over the microphone.

Although the cover 208 is shown as sliding over the entire protectivecover 210, the audio device may alternatively be designed such that theprivacy cover only covers the microphone, and not the speakers. Forexample, the microphone and speaker may be located in differentpositions on the audio device as discussed above, and the protectivecover may only slide over the microphone.

The indicator LED 205 of device 200 may be used to indicate when theprivacy mode is enabled. For example, when the privacy mode is enabledor engaged by moving the privacy cover 208 over the protective cover210/microphone, the LED 205 may turn on/illuminate to indicate that theprivacy mode is on/active. Alternatively, the LED 205 may remain onduring normal mode (i.e., not in privacy mode) but may turn off in whenthe audio device 200 is in privacy mode. Device 200 may be configuredsuch that when the privacy cover 208 is not in privacy mode, the privacycover may physically depress a lever, button, switch or other depressionmechanism. The depression of the lever, button, switch etc. may causeLED 205 to not illuminate. Similarly, when the privacy cover is slidover the microphone thus enabling privacy mode the privacy cover mayrelease the level, button, switch etc., which may cause the LED 205 toilluminate. One having ordinary skill in the art will recognize thatdevice 200 may alternatively be configured to illuminate the LED 205when the device 200 is not in privacy mode, and to not illuminate theLED 205 when the device 200 is in privacy mode. Further, one willrecognize that other configurations and mechanisms may be used tocontrol the illumination of LED 205 with respect to the movement ofprivacy cover 208 and the enabling/disabling of privacy mode/normalmode.

Other configurations of privacy cover 208 are possible. For example,FIG. 3 shows another example audio device 300. Audio device 300 may havesimilar elements as those shown on the audio device 200 of FIG. 2 . Forexample, the indicator LEDs 306, privacy LED 305, yoke 301 with holes303, and volume adjustment actuators 302, 304 may correspond to elements206, 205, 201, 203, 202, and 204, respectively.

Audio device 300 may be similar to the audio device 200 as shown in FIG.2 and use a privacy cover 308 to provide a device-level privacy modesimilar to privacy cover 208. According to this example, themicrophone(s) of the audio device 300 may be located in a differentposition(s) than the speaker(s) on the audio device. For example, thespeaker may be located behind the protective cover 310. The audio devicemay have a user interface/front surface 315. In addition to including aprotective cover 310, privacy LED 305, indicator LEDs 306, and volumebuttons 302 and 304, the user interface may contain one or more holes orcavities such as holes/cavities 320A and 320B. Each cavity 320A, 320Bmay have one or microphones recessed behind the user interface 315. Themicrophones may be exposed to the environment by the cavities 320A,320B; that is, the microphones may receive sounds/audio from theenvironment through the cavities 320A and 320B.

A user may slide the privacy cover 308 within a housing (i.e., behindthe user interface 315) along direction W (left and right, for example),to place the audio device in and out of privacy mode. When the audiodevice is placed in privacy mode (such as by sliding the coverhorizontally to the right along direction W), a portion of the privacycover 308 that may be recessed inside the housing of the audio devicemay slide between the cavities 320A, 320B and the microphones behind therespective cavities. The cover 308 may effectively block the microphonesfrom receiving audio that enters from the user interface/front surface315 through the cavities 320A, 320B.

Similar to device 200 and privacy cover 208, device 300 and privacycover 308 may be configured such that when the privacy cover 308 ismoved to place the device 300 into the privacy mode, privacy LED 305 maybecome illuminated. When the cover is moved to normal mode (i.e.,non-privacy mode), the privacy LED 305 may turn off, or not illuminate,or vice versa. One will understand that privacy LED 305 may be housedwithin cavity 320A and/or 320B to indicate a privacy mode.

According to an alternative or further example, a portion of the privacycover 308, or the housing in which the cover slides, may have adifferent color than the rest of the cover 308. The color may indicateto a user that the audio device is in a privacy mode. For example, whenthe cover 308 is moved to the right along direction W to thus cover themicrophone cavities 320A, 320B and mute the microphones, the portion ofthe cover which may be viewed by a user through the microphone cavities320A, 320B may be red in color.

When the device 300 is not in privacy mode, that is, when the privacycover 308 is moved to the left as shown in FIG. 3 , the privacy cover308 may have an exposed area 330. The exposed area may be the same coloras the privacy cover. When the privacy cover is slid to the right alongdirection W to place the audio device in privacy mode, a similar area tothe left of the privacy cover may be exposed. The exposed area to theleft of the privacy cover may be red in color to indicate that the audiodevice is in a privacy mode. Additionally, or alternatively, the portionof the housing in which the privacy cover slides that is viewable by auser when the audio device is in privacy mode may be a different colorthan the rest of the cover 308. Although the color red has been usedherein as an example, any color, pattern, or other visual indication ofprivacy mode may alternatively be used.

Turning now to FIG. 4 there is shown an example block circuit diagram ofan audio device 400, such as may represent any of audio devices 200 and300 shown in FIGS. 2 and 3 . The audio device 400 may be powered by apower source 402. The power source 402 may be any suitable alternatingcurrent (AC) or direct current (DC) power source. For example, the powersource 402 may be an AC line voltage. Alternatively, the power source402 may be a DC power source, such as a 12- or 48-volt supply providedby low voltage wires, Power over Ethernet (PoE), battery, solar cell,etc. The audio device may contain at least one power supply 422 whichsupplies a voltage V_(CC) for powering the electronic circuitry of theaudio device. The power supply 422 may be integrated with the audiodevice, or the power supply may be provided as an AC to DC power supplyadapter which may be used to connect the audio device to a wallreceptacle, such as power source 402.

The audio device 400 may have a control circuit 414. The control circuitmay be powered by the voltage V_(CC) provided by the power supply 422.The control circuit may include one or more of a processor(s) (e.g., amicroprocessor(s)), a microcontroller(s), a programmable logic device(s)(PLD), a field programmable gate array(s) (FPGA), an applicationspecific integrated circuit(s) (ASIC), or any suitable controller orprocessing device or combination thereof.

Audio device 400 may include one or more microphone(s) 430. Microphone430 may include a power input lead for receiving a supply voltage V_(CC)for powering the microphone. Microphone 430 may also include one or moredata output leads 426. The data output leads 426 may communicate analogor digital audio data. For example, the microphone may use an inter-ICsound protocol (I2S), which may use a digital pulse code modulation(PCM) to communicate the microphone data and may include one or moreclock lines. In another example, the data output lead may use a digitalpulse density modulation (PDM). Other data lines and protocols arecontemplated.

The control circuit 414 may be adapted to receive audio signals from themicrophone 430. That is, the control circuit 414 may be in electricalcommunication with the microphone 430 via the data output leads 426. Themicrophone may be a standalone microphone with external circuitry, orthe microphone may be a single package such as a chip or daughterboardthat includes an integrated amplifier. For example, the microphone maybe a MEMS (Micro-Electro-Mechanical System) microphone. One examplesuitable microphone may be a MP45DT02-M MEMS audio sensoromnidirectional digital microphone, manufactured by STMicroelectronics.Alternatively, the microphone may be an electret microphone, condensermicrophone, or any other broadband acoustic input device available in asuitably small package size.

The microphone 430 may comprise multiple input microphones. For example,the microphone 430 may be a group of microphones physically spaced apartfrom one another, for example, a microphone array. Multiple inputmicrophones may allow for improved ambient noise rejection and acousticbeam-forming or beam-steering, whereby the audio device may bedirectionally sensitive to input sounds.

The audio device 400 may contain one or more communication circuits 424which are operably connected to the control circuit 414. Thecommunication circuit 424 may be a wireless communication circuit andmay send or receive wireless commands and/or data to an external deviceor network. Alternatively, the communication circuit 424 may be a wiredcommunication circuit, for example, connected to a USB-C, Ethernet orCATS, Serial cable, or any other type of communication wiring. Forexample, the communication circuit 424 may send acoustic data to aremote network for acoustic processing. The remote network may belocated on a cloud server hosted on the Internet. The audio device maycommunicate to the remote network via one or more intermediary devices,such as a hub device and/or a router device. The communication protocolmay include one or more of the following: Wi-Fi, ZigBee, Bluetooth, orother similar protocols with sufficient bandwidth to transmit audiodata.

The audio device 400 may have one or more memory modules (“memory”) 420(including volatile and/or non-volatile memory modules) that may benon-removable memory modules and/or removable memory modules. Memory 420may be communicatively coupled to the control circuit 414. Non-removablememory 420 may include random-access memory (RAM), read-only memory(ROM), a hard disk, or any other type of non-removable memory storage.Removable memory 420 may include a subscriber identity module (SIM)card, a memory stick, a memory card, or any other type of removablememory. The memory 420 may store one or more software based controlapplications that include instructions that are executed by the controlcircuit 414. The control circuit, when executing such instructions, mayprovide the functionality described herein. The memory may also storedata including operating parameters. As a further example, the controlcircuit may store acoustic data received by the control circuit from themicrophone 430 in the memory 420. For example, the memory 420 may act asa buffer for temporarily storing acoustic data to be transmitted to aremote server 140 for acoustic processing via the communication circuit424. Other examples are possible.

The audio device may also include one or more speakers 432 coupled tothe control circuit 414. The speaker(s) 432 may provide audiblecommunication and/or feedback to a user. For example, the speaker(s) 432may allow the audio device 400 to communicate audibly with a user, orthe speaker(s) may be used to play music, etc. The control circuit 414may send acoustic data to the speaker(s) 432 to generate audio signals.For example, the control circuit 414 may receive acoustic data from thecommunication circuit 424 and may send the acoustic data to thespeaker(s) 432. The speaker(s) 432 may then play/communicate theacoustic data to a user. For example, the acoustic data received from acloud server may be a response to a question asked by the user, and thecontrol circuit 414 may be configured to cause the speaker(s) 432 toacoustically broadcast the response/answer for the user. The audiodevice may further include a volume control 434 coupled to the controlcircuit 414 and for controlling the output volume of speaker 432.

Additionally, the audio device may include one or more indicator LEDs,shown here as volume LEDs 442, for example, that may be similar toindicator LEDs 206 shown in FIGS. 2 and 3 . For example, the volume LEDs442 may be an array of LEDs. The volume LEDs 442 may be used to indicatea volume level of the speaker(s) 432. For example, each LED in the fullarray of LEDs 206 may light up to display a maximum volume level, whileonly half (or approximately half) of the LED array may light up to showa volume level of 50 percent of maximum volume.

The audio device may further include one or more indicator LEDs, shownhere as privacy LED 440, that may be used to indicate when the audiodevice is in privacy mode. For example, when a user places the audiodevice 400 into a privacy mode, the privacy LED 440 may turn on.Alternatively, the privacy LED 440 may be on during normal operation andmay turn off when a user places the audio device 400 into the privacymode. In this way, the LED 440 may be a privacy indicator LED.

The audio device 400 may further include a switch 444. The switch 444may be actuated when the privacy mode is enabled. A describedpreviously, the switch may be depressed by a lever, button, etc. Forexample, when the privacy cover is over the microphone 430 (i.e., theaudio device 400 is in privacy mode), the switch 444 may be in a closedor “on” position. The closing of the switch 444 may turn on the privacyLED 440 to indicate to a user that the audio device 400 is in privacymode. For example, the switch 444 may be connected to the controlcircuit 414. When the control circuit 414 detects that the switch 444has been actuated, the control circuit may turn on the privacy LED 440.

In a second example, different from what is shown in FIG. 4 , the switch444 may be connected in series electrical connection between the supplyvoltage V_(CC) and the privacy LED 442. When the privacy cover is slidover the microphone, the switch 444 may be depressed into the “on”position, thereby providing power to the privacy LED 442 to turn on theLED. In this way, the switch 444 may control the illumination of theprivacy LED 440.

The audio device 400 may include additional circuitry not shown here,including, but not limited to: actuators, load control circuitry,passive infrared occupancy sensing, microwave occupancy sensing, ambientlight sensing, timeclock or time-of-day tracking, and the like.

FIG. 5 is an example of an audio device 500 according to a anotherembodiment. Similar to the audio devices shown in FIGS. 2 and 3 , theaudio device 500 may additionally have a microphone, speaker, protectivecover 510, volume adjustment actuators 502, 504, and privacy LED 505, aswell as other elements similar to these figures and labeled withcorresponding numbers. Alternative to the protective cover shown inFIGS. 2 and 3 , the audio device 500 may include a mute or privacybutton 508 located on a front surface 515. A user may physically pressthe privacy button 508 to stop or prevent the audio device fromdetecting and/or transmitting audio. The privacy button 508 may be aphysical button actuator, or the button may be a capacitive or resistivetouch area. When the privacy button 508 has been pressed, the privacyLED 505 may turn on to indicate that the device is in privacy mode.

The circuit for LED 505 may be designed such that LED 505 is a trueprivacy indicator; that is, the LED is not able to be compromised bymalicious software, as will be discussed in further detail herein.Conversely, LED 505 may remain on while the audio device 500 is not inprivacy mode, and turn off when the privacy button 508 has been pressed.The audio device 500 may also have a design as similarly shown in FIG. 4, where the switch 444 may be the privacy button 508. This configurationmay also enter privacy mode by receiving a command from thecommunication circuit 424.

The privacy indicator, or LED 505, shown as privacy LED 440 in the blockdiagram of FIG. 4 , may be a true privacy indicator, that is, theprivacy indicator may be coupled to the power of the microphone. Thetrue privacy indicator may rely on the microphone power to either turnthe LED on or off. The coupling between the true privacy indicator andthe microphone power may ensure that the true privacy indicator may notbe manipulated or falsely altered in state by malicious software.

FIG. 6 is an example schematic diagram of a true privacy indicator foran audio or video device. The true privacy indicator may be an LED D1,that is, privacy LED 640, which may be similar to the LED 440 shown inFIG. 4 . The LED 640 may be hard-wired to change state when the audiodevice is placed in privacy mode. For example, the LED 640 may turn onwhen the audio device is placed into privacy mode, and turn off whenprivacy mode is disabled. Alternatively, LED 640 may turn off when theaudio device is placed into privacy mode, and turn on when privacy modeis disabled. The true privacy indicator may also include additionalcircuitry, shown here as a PNP bipolar junction (BJT) transistor Q3, anNPN BJT Q1, and a resistor R1. One will understand that other types oftransistors, for example, field-effect transistors (FETs) mayalternatively be used.

The state of the LED 640 (that is, on or off) may be physically tied tothe state of the microphone, and may not be independently controllablevia software. For example, the microphone 630 may have a power supplyline 620 that is controlled by the control circuit 614, and at least oneother line 626. For example, the microphone 630 and the control circuit614 may correspond to the microphone 430 and control circuit 414 of FIG.4 . Line 626 may be a data or communication line, which may be connectedto the control circuit 614 as previously shown and described withreference to line 426 in FIG. 4 . The control circuit 614 may have aprivacy enable pin 610. The privacy enable pin 610 may control whetheror not power is provided to the microphone 630 on the microphone powersupply line 620. The privacy enable output pin 610 may be controlledbased on a privacy mode input. For example, the privacy mode input maybe provided when a user places the audio device in a privacy mode. Forexample, the control circuit may control the privacy enable pin 610 inresponse to a button press (i.e., a user has pressed the mute or privacybutton, for example, button 508, or has slid a privacy cover over themicrophone, thereby depressing a switch, for example, privacy cover 208,308), as in the embodiments shown in FIGS. 2, 3 and 5 . Or, the buttonpress may be a remote button press, as in a remotely enabled privacymode. That is, a user may press a button on a device separate from theaudio device to place the audio device (and/or additional audio devices)into privacy mode. For example, a user may press a software button on agraphical user interface (GUI) of a mobile phone, or a button on aremote control, keypad, etc., to place the audio device into privacymode. The control circuit may control the privacy enable pin 610 inresponse to receiving a wireless/wired communication that a remoteprivacy button has been pressed.

As shown here, the LED 640 may be connected in series electricalconnection between the power supply line 620 of the microphone 630through a resistor R1, and the power supply V_(CC); however, the LED 640has no direct line of control from the control circuit 614. In this way,the LED 640 may be a true privacy indicator, such that a malicioussoftware update may not be capable of falsely turning on (or off) theLED 640 to falsely convince a user that the device is in privacy modewhile the microphone is still active.

When the privacy enable pin 610 is pulled up to a logic high level(e.g., to V_(CC)), the transistor Q3 may be off and transistor Q1 may beon. When transistor Q1 is turned on, current may flow from V_(CC) alonga current path I1. That is, the current path from V_(CC) may go throughthe transistor Q1 to supply power to the microphone on power supply line620, and bypassing a higher resistance path I2 through D1 (LED 640) andR1. Therefore, the privacy indicator LED 640 may normally be off whenthe microphone 630 is on (i.e., when the microphone has power).

When the privacy enable line 610 is pulled to a logic low voltage (e.g.,zero volts) as a result of putting the device in privacy mode, thetransistor Q1 may turn off and transistor Q3 may turn on. Whentransistor Q3 turns on, current may flow through the current path I2from the power supply rail V_(CC) through LED 640 and resistor R1 andthrough the body of Q3 to ground. When current flows from V_(CC) throughthe LED 640, the LED 640 may turn on, indicating that the device is inprivacy mode.

Transistor Q3 may be selected to have a sufficiently low voltage dropacross the collector-emitter junction (V_(CE)) in the on state (i.e.,the voltage between the microphone power supply line 620 and ground),such that the voltage provided to the microphone when LED 640 is on maybe too low to power the microphone 630. For example, V_(CC) may be 3.3volts and V_(CE) may be 0.25 volts. During normal operation (not privacymode), the voltage supplied to the microphone may be substantially 3volts (the voltage drop across the body of transistor Q1 may benegligible). However, when Q1 is off and Q3 is on, the voltage providedto the microphone on the power supply line 620 may be set by the voltagedrop V_(CE) of Q3. For example, for microphone STM MP45DT02, the powersupply may require a minimum voltage of approximately 1.6 volts. Whentransistor Q3 turns on, thereby turning on LED 640 and providing 0.25volts to the microphone power supply line 620, the power supplied to themicrophone 630 may be below the minimum power supply range required forthe microphone to turn on, and therefore, the microphone may remain offwhile LED 640 is powered. In this way, LED D1 may be a true privacyindicator, such that if the control circuit 614 were to experience amalicious software update, the privacy indicator LED 640 would not becontrolled by the control circuit 614. Therefore, the compromised audiodevice would not be able to falsely turn on the privacy LED 640 whilethe microphone 630 remained on, or active.

The resistor R1 may be selected to set the current through LED 640. Forexample, for a desired LED 640 current of 20 milliamperes (mA), a V_(CC)of 3.3V, a voltage drop V_(CE) of Q3 in the on state of 0.25V, and aforward voltage drop across LED 640 of 2V in the on state, the voltageacross R1 may be approximately 1V. Therefore, R1 may be selected havinga resistance of approximately 50 ohms. For example, R1 may be 47 or 56ohms, according to resistor series standard values and manufacturingtolerances.

One will understand that the schematic diagram shown here is only oneexample circuit displaying how a true privacy indicator may beaccomplished. For example, the value of R1 may be adjusted based on theother components of the circuit. Also, although only one LED D1 isshown, multiple LEDs may be used. Further, other circuit components maybe used in place of Q1 and Q3, etc. Additionally, as previouslydiscussed, although the LED D1 has been described here as turning on inprivacy mode and off when the audio device is not in a privacy mode, itis readily apparent that the opposite mechanism wherein the LED D1 turnsoff in privacy mode and on when the audio device is not in privacy mode,could also easily be envisioned and designed by one of ordinary skill inthe art. Additionally or alternatively, the true privacy indicator mayact to break the communication line 626 of the microphone instead of, orin addition to, the power line 620.

FIG. 7 is another example audio device according to another embodiment.The audio device 700 of FIG. 7 may have similar features as the audiodevices shown in FIGS. 2, 3 and 5 , for example, with the privacy LED705, LED array 706, yoke 701 with mounting holes 703, user interface ona front surface 715, protective cover 715, and volume up and downbuttons 702, 704, respectively, being substantially the same aspreviously described.

The audio device 700 may also have a device-level privacy mode. Thedevice-level privacy mode of audio device 700 may be a mechanicaldisconnect. The mechanical disconnect may be an airgap, i.e., an airgapswitch shown here as airgap switch 729. Although described here as aswitch, the airgap switch may be a tab, such as a push/pull controlwhich may be either pulled out or pushed in by a user. Other mechanismsin addition to those shown here may also be used, such as rotating aknob, flipping a switch, pulling a lever, sliding a tab, etc.

Mechanical actuation of the airgap switch may break an electricalconnection of a circuit of device 700, for example, similar to thecircuit shown in FIG. 4 . The airgap switch may be located anywhere onthe audio device that is accessible to the user. For example, the airgapswitch may be located on the front surface 715 of the audio device,wherein the front surface is readily exposed to a user. As one example,airgaps such as the one shown here are described in greater detail inU.S. Pat. No. 7,365,282, issued Apr. 29, 2008, entitled “PULL OUT AIRGAP SWITCH FOR WALLBOX-MOUNTED DIMMER”, the entire disclosure of whichis herein incorporated by reference.

The mechanical disconnect may be a single airgap, shown in FIG. 7 asairgap switch 729. That is, the airgap switch 729 may disconnect orbreak an electrical connection at a single point in the circuit of theaudio device 700, thereby creating an airgap. For example, when a userpushes or pulls the airgap switch 729, the airgap may electricallydisengage part of the circuit. The airgap switch 729 may physicallybreak power to the entire device 700. Alternatively, the airgap maybreak an electrical connection of just a microphone line. For example,the airgap switch 729 may break power to the microphone. Or, the airgapswitch 729 may break a communication line of the microphone. Locationsof the airgap caused by the airgap switch within the circuit of theaudio device will be described in greater detail herein below.

FIG. 8A is an example block diagram of an audio device 800 with anairgap privacy mode, as described previously for audio device 700 ofFIG. 7 . The audio device 800 may have many of the same components asthe audio device 400 shown in FIG. 4 , for example. For example, theprivacy LED 840, microphone 830, speaker 832, control circuit 814,volume LEDs 842, volume control 834, memory 820, power supply 422, andpower source 402 may be the same or similar to those previouslydescribed in FIG. 4 . Additionally, the audio device 800 may include oneor more airgaps. The airgap switch, shown here as 829A-C may be locatedin any of several places A-C. The airgap switch may provide a manualdisconnect to place the audio device 800 into a privacy mode. The airgapswitches 829A-C may enable privacy mode by breaking a power orcommunication connection in any of the various places indicated in thecircuit to create a breakpoint, or airgap.

For example, the audio device may have an airgap 829A, which may belocated at airgap position A. When the airgap switch 829A is engaged bya user, the airgap 829A may disconnect the power supply 822 from thepower source 802, thereby removing power to the entire audio device 800.

Alternatively, the audio device may have an airgap switch 829B. Theairgap switch 829B may be located at position B, shown in FIG. 8A aslocated between the output of the power supply 422 and the V_(CC) rail.When a user engages the airgap switch 829B to put the audio device 800into a privacy mode, the airgap switch 829B may break the connectionproviding power from the power supply V_(CC) to the microphone 830.Actuation of the airgap switch 829B may not remove power from allcircuitry powered by V_(CC). For example, the control circuit 814, LEDs842, microphone 830, speaker 832, communication circuit 824, and memory820 may all remain powered from V_(CC). In this way, when the audiodevice 800 is placed in a privacy mode through airgap switch 829B, onlythe microphone may lose power while other circuit components remainactive. For example, the privacy LED 440 may still be used to provide avisual indication that the audio device 800 is in privacy mode.

Although not shown, V_(CC) may alternatively be provided to just thecontrol circuit 814 or to just the communication circuit 824. Forexample, the airgap switch 829B may alternatively remove power to justthe control circuit 814 so that the control circuit 814 is unable toreceive communication from the microphone 830. Or, the airgap switch829B may remove power to the communication circuit 824. In this way, theacoustic data may still be sent from the microphone circuit 830 to thecontrol circuit 814 to allow the control circuit to do limited localaudio processing. For example, the control circuit may be able toprocess a keyword, or a simple learned command. However, when the airgap829B is engaged, more extensive commands and voice conversations may notbe transmitted to a network or cloud service for remote processing.

Alternatively, the audio device may have an airgap switch 829C. Airgapswitch 829C may be located at position C, between the microphone 830 andthe control circuit 814. When a user engages the airgap switch 829C toput the audio device 800 into a privacy mode, the airgap switch 829C maybreak the communication connection between the microphone 830 and thecontrol circuit 814. That is, when a user enables or engages the privacymode, the control circuit 814 to stop receiving acoustic data from themicrophone 830. As previously described, the other components (i.e., thecontrol circuit 814, memory 820, speaker 832, LEDs 840, andcommunication circuit 824) may remain powered and active while theairgap switch 829C is engaged (i.e., while the audio device 800 is inthe privacy mode). Maintaining the other components in the powered or onstate may allow the audio device to have an increased response time whenthe privacy mode is disengaged, as the other components will not gothrough a power cycle. One will understand that the embodimentsdescribed herein are not limited to these example placements of theairgap switch, but rather an airgap switch may be used to disconnectpower or communication in any part of the electrical circuit.

Additionally, other types of mechanical privacy actuators may be used asalternative designs to achieve the same effects as the airgap switchdescribed here. Each of these alternative designs may be consideredwithin the scope of the invention described herein. For example, themechanical privacy actuator may be attached to a solenoid which controlspower to the microphone or voice circuitry based on the state of thesolenoid.

Alternatively, the mechanical privacy actuator may maintain or break anoptical connection to place the device into a privacy mode. For example,the power or communication to the microphone may be enabled or providedvia a phototransistor which remains on by receiving light from aphotodiode. The optical connection between the phototransistor and thephotodiode to maintain the microphone circuitry may be mechanicallyinterrupted by a privacy actuator which creates a physical barrierblocking light from the photodiode to the phototransistor.

In another embodiment, a transmitter-receiver pair of infrared orvisible light diodes may optically enable power to the microphone. Whenthe privacy actuator is enabled or placed in the privacy mode, theoptical connection between the emitter and receiver pair may be broken.For example, the transmitter and receiver pair may be located adjacentto, and parallel to, each other. The transmitter and receiver pair maymaintain power to the microphone by bouncing power off a reflectivesurface which the transmitter and receiver both face. When the privacymode is enabled, the reflective surface may move to either expose a gapor a black surface to break the connection between the pair. Or, thetransmitter and receiver pair may face each other as described with thephototransistor and the photodiode pair above.

FIG. 8B is an example block diagram of an audio device 800′, withsimilar elements as the block diagram FIG. 8A having similar numbers,having the addition of a second control circuit 855′, which will bebetter understood as described in accordance with FIG. 9 .

FIG. 9 is an example of an alternate airgap mechanism for an audiodevice. Audio device 900 has many similar features of the audio device700 as shown in FIG. 7 , shown with similar numbers, i.e., yoke 901 withholes 903, volume control 902, 904, privacy LED 905, LED array 906, etc.Additionally, the audio device 900 may be capable of remotely re-settingthe privacy mode. The audio device 900 may include an airgap switch 929.The airgap switch 929 may be a remote reset rocker switch, i.e., aremote reset switch, which may be located on a front surface 915 of theaudio device 900 and accessible to a user. For example, the airgapswitch 929 may be a rocker switch that turns privacy mode on and offwhen a user flips or actuates the airgap switch.

The audio device 900 may provide a visual indication of privacy modewhen privacy mode is enabled. For example, the audio device 900 may turnon LED indicator 905 when the airgap switch 929 is set to the privacymode. Additionally, or alternatively, the airgap switch 929 may have anindicator area 931 that is visible when the switch is in privacy mode.That is, the indicator area 931 on the left side of the airgap switch929 may be exposed or visible when the airgap switch is in an “on” orprivacy position. The indicator area 931 may contain an icon which mayindicate to a user that the audio device 900 is in a privacy mode, forexample, the mute signal as shown. Alternatively, the indicator area 931may be a color, such as red.

An example airgap switch that may be used is Remote Reset Rocker SwitchA8GS, manufactured by Omron Corporation. This switch has a reset lineconnected to a solenoid coil that may allow a user to enable the privacymode remotely. For example, the audio device may receive a trigger(i.e., an indication to go into privacy mode). In response to receivingthe trigger, the control circuit of the audio device may cause theremote reset switch to change state to enable the privacy mode. Thetrigger may be any input as previously described, including, but notlimited to: occupancy, a specific sound (spoken keyword or soundindicative of an activity, such as a phone ringing), a wireless command,etc. For example, the control circuit may apply a voltage to a resetline or a coil terminal of the remote reset switch to change the stateof the remote reset switch in response to receiving the trigger, therebyplacing the audio device in the privacy mode.

Although the privacy mode has been described as being enabled remotely,the visual indication of the position of the remote reset switch may beprovided locally to a user to indicate that the airgap switch is eitherin privacy mode or that privacy mode has been disabled. For example, theremote reset switch may expose an icon and/or color when the remotereset switch is in the privacy mode, as previously described. The statechange of the airgap switch flipping positions may also provide audiofeedback confirmation to a user within the environment when the privacymode has been set. For example, if a user remotely resets the airgapswitch 929 to place the audio device 900 in a privacy mode, (i.e.,transmits a wireless command to put the device 900 into privacy mode)the user may then need to physically engage the airgap switch to disablethe privacy mode. That is, the privacy mode may not be disabled remotelyfrom the device.

The audio device 900 of FIG. 9 may have a block diagram similar to theblock diagram of FIG. 8A and/or FIG. 8B. The airgap switch 929 maycorrespond to any of the airgap switches 829A-C shown in FIG. 8A, withthe addition of a reset line connecting the airgap switch to the controlcircuit 814 to enable the control circuit to reset the airgap switch929C. One example is shown as the reset line 850 to airgap switch 829Cin FIG. 8A. One will understand a reset line to any of the otherairgaps, 829A and 829B, respectively, may alternatively be used(although not shown).

Additionally, when the airgap switch 929 is in either positions 829B or829C as shown in the block diagram of FIG. 8A, the privacy LED 905 ofFIG. 9 may also turn on to indicate that the audio device 900 is in theprivacy mode. The control circuit may detect when the switch 929 hasbeen placed in the privacy mode and may control the privacy LED 905 toturn on. For example, the control circuit may determine that themicrophone 830 has stopped communicating with the control circuit (i.e.,the data line connection 826 or the power supply line connection to themicrophone 830 has been opened). In response to determining that themicrophone 830 has ceased communication, the control circuit 814 mayturn on the privacy LED 905 (shown as 840 in FIG. 8A). Alternatively,for a remote command to place the device into a privacy mode, thecontrol circuit may reset the airgap switch 929 and also turn on theprivacy LED 905. The privacy LED 905 may further be turned off when thecontrol circuit 814 begins receiving data from the microphone 830, i.e.,to indicate to a user that the device is no longer in privacy mode.

Alternatively, or in addition to, the device-level privacy modesdescribed herein, a privacy mode may be enabled by providinginterference signals. Interference signals may be acoustic interferencesignals (i.e., audio signals), or they may be electronic noise signalsadded to the microphone communication line. For example, an interferencespeaker may provide acoustic interference. The acoustic interference mayraise the background noise level of the microphone such that theacoustic data received by the microphone from a user in the environmentis not discernable from the acoustic interference by the controlcircuit. The noise signals may be pseudo-random noise signals generatedby the control circuit. Alternatively, a separate control circuit may beused to generate the noise signals to obfuscate the acoustic data. Forexample, turning now to FIG. 8B, the second control circuit 855′ may beused to generate noise. In this way, the primary control circuit 814′which receives the obfuscated acoustic data may not be able to subtractout the noise signal, since the noise signal was generated by anindependent source, i.e., the separate control circuit.

The interference speaker providing the acoustic interference may be asingle speaker or may be multiple speakers. For example, theinterference speaker may be speaker 832′ in FIG. 8B which is provided anoise signal 870′ by the second control circuit 855′. This may beimplemented in any of the audio devices described herein, including theaudio devices of FIGS. 2, 3, 5, 7, and 9 . The interference speaker 832′providing the acoustic interference may be integrated with the audiodevice, that is, may be located within the housing of the audio device.For example, the interference speaker may be the speaker 832 of FIG. 8A,and/or an additional speaker located within the housing of the audiodevice. Alternatively, the interference speaker may be locatedexternally to, and proximate to, the audio device.

The acoustic interference may be an audible interference. For example,the acoustic interference may be a white noise interference.Alternatively, the acoustic interference may be a pink noise or greynoise interference. One skilled in the art will recognize that the exactacoustic spectrum of the acoustic interference is not critical; rather,the effectiveness of the interference is based on broadband coverage ofaudible range frequencies and having sufficient amplitude (i.e., volume)to drown out ambient conversations. That is, the amplitude of the noisesignal is at least of substantially the same amplitude as the amplitudeof the audio signals. Additionally, the audible nature of the acousticinterference may allow a user to have audible feedback that aninterference privacy mode has been enabled. The separate control circuitmay be configured to generate the acoustic noise signal and provide theacoustic noise signal to the interference speaker for broadcasting theacoustic noise signal. The noise from the interference speaker 832′ maythen be received by, and couple to, the microphone 830′ of the audiodevice such that the noise signal may mix with the received speech tocreate obfuscated acoustic data 875′.

In addition to the interference modes described, the acousticinterference may be an ultrasonic interference. The frequency of theultrasonic interference may be outside of the range of human hearing butwithin the frequency response range of the microphone. For example, thefrequency may be greater than or equal to 20 kilohertz. The audio devicemay be designed so that the ultrasonic interference may saturate themicrophone input, that is, the microphone output is substantially equalto V_(CC).

Alternative to an acoustic interference, electrical noise may be addedto the acoustic data. For example, the second control circuit 855′ maygenerate an electrical noise signal 865′ which is added directly or viaa sum function 860′ to the acoustic data 830′. The addition of theelectrical noise signal 865′ to the acoustic data 830′ may generate anobfuscated signal 875′, which may be a mix of the electrical noisesignal and the noise signal. That is, the noise may be added to acommunication line of the microphone 430 through the separate secondcontrol circuit. The separate second control circuit 855′ may behard-coded and not updateable via software, and additionally notconnected to the primary control circuit. The separate second controlcircuit 855′ may be used to generate the electrical noise such that theprimary control circuit, i.e., control circuit 814, may not be able tocancel out or remove the noise from the acoustic data of the microphonecommunication line.

The control circuit 814′ may provide a signal 880′ to the second controlcircuit 855′ to indicate to the second control circuit 855′ when toenter the privacy mode (i.e., when to generate noise signals). When thecontrol circuit provides a signal 880′ to the second control circuit855′, the second control circuit may begin providing noise signalseither electric noise signals 865′ or acoustic noise 870′ to create theobfuscated data 875′. Further, the primary control circuit may not beable to discern words when performing voice recognition on theobfuscated data. Alternatively, the wireless control circuit maytransmit the obfuscated acoustic data to a server for voice processing,wherein the server may also not be able to discern words when performingvoice recognition on the obfuscated data, thereby masking or concealingany words spoken during the time when the acoustic data has beenobfuscated. When the control circuit 814′ determines the device 800′ isno longer in the privacy mode, the control circuit 814′ may ceaseproviding the signal 880′ to the second control circuit 855′ to causethe second control circuit 855′ to stop generating the noise signal andthereby the control circuit 814′ will cease receiving the obfuscateddata 875′.

Any of the embodiments discussed herein may be integrated into any ofthe devices shown in FIG. 1 . As one example, the audio device may beintegrated into a load control device, such as load control device 104.FIG. 10 is an example audio device 1000 that may also be a load controldevice. The audio device 1000 may have many similar features as theaudio devices shown and described in FIGS. 2, 3, 5, 7, and 9 , and mayalso control an electrical load. For example, the audio device 1000 maycontrol an electrical load such as a lighting load, a motorized windowtreatment, etc., such as the load control device 104 shown in FIG. 1 .

The audio device 1000 may have a speaker and microphone located behind aprotective cover 1010; a volume up adjuster 1002 and a volume downadjuster 1004 for adjusting a volume level of the speaker; LEDindicators 1006 for showing a volume level; a privacy LED 1005; and aprivacy airgap switch 1029, all similar to elements previously describedin the preceding figures. One will recognize the audio device 1000 couldadditionally have a privacy cover as shown in FIG. 2 or 3 , or it mayhave a mute or privacy button as shown in FIG. 5 , a privacy switch orairgap switch as in FIG. 9 , etc.

The audio device 1000 may additionally include an actuator 1008 forcontrolling an electrical load. The actuator 1008 may be a singleactuator as shown, located on a front surface 1015 of the audio device1000. A user may press the actuator 1008 to control the electrical load,such as turn a lighting load on and off, raise lower a shade. Otheractuators are possible. For example, if the lights are on, a user maypress the actuator 1008 to turn the lights off. Or, if the lights areoff, a user may press the actuator 1008 to turn the lights on.Alternatively, the actuator 1008 may include multiple actuators. Forexample, the load control device 1000 may control an electrical loadsuch as a lighting load. The actuator 1008 may include an on/offactuator, and one or more additional actuators for dimming a lightingload up and down.

The audio device 1000 may also include an indicator LED 1005. Theindicator LED 1005 may indicate the state of the load. For example, theindicator LED may turn on when the load is on, and the indicator LED mayturn off and/or appear dark when the load is off. The indicator LED mayalso be incorporated with the actuator 1008. Audio devices withintegrated load control will be described in greater detail herein.

The audio device 1000 may further include a second airgap switch 1030which may turn off power to the entire device. For example, a user maydisconnect airgap switch 1029 to put the audio device 1000 into privacymode without losing the ability to control the load (i.e., pulling outthe privacy airgap switch 1029 may not remove power to the loadcontrolled by the audio device load control 1000). However, a user maydisconnect power to the load via the airgap switch 1030. For example, auser may pull out the airgap switch 1030 to remove power to a lightfixture to change a lightbulb within the light fixture.

FIG. 11 is an example block diagram of an audio device 1100 withintegrated load control, such as device 1000 shown in FIG. 10 . In thisexample, device 1100 is an audio device that is also a control devicefor a lighting load. The audio device 1100 may have similar circuitry asthe audio device 800, 400 shown in FIGS. 8, 4 , respectively. Forexample, the audio device 1100 may have one or more privacy LED(s) 1140,a volume control 1134, one or more volume LEDs 1142, microphone(s) 1130,speaker(s) 1132, privacy airgaps 1129B and 1129C, etc. One distinctionhere is that the privacy airgap switch shown in FIG. 8A as 829A is now aseparate airgap switch 1130, which is electrically located in the samearea of the circuit 1100 as the circuit 800; however, airgap switch 1130also now removes power to the electrical load 1104. The airgap switch1130 corresponds to the airgap switch 1030 as previously described inFIG. 10 .

Additionally, the audio device 1100 may have load control circuitry. Theaudio device 1100 may have a hot terminal H for receiving power from anAC line voltage 1102. The audio device 1100 may have a dimmed hot orswitched hot terminal DH for providing power to a load 1104. The load1104 may be a lighting load, such as an LED, a compact fluorescent lamp(CFL), incandescent lamp, halogen lamp, etc. The audio device 1100 mayadditionally have a neutral terminal N, or may be referenced to aninternal ground reference.

The audio device 1100 may have a zero-cross detector 1118 and a loadcontrol circuit 1110. The zero-cross detector 1118 and the load controlcircuit 1110 may both be electrically connected to the hot terminal Hand the control circuit 1114. The zero-cross detector may monitor theline voltage from the hot terminal H to detect when the line voltagereaches a minimum. When the line voltage reaches a minimum, thezero-cross detector may provide a zero-cross timing signal to thecontrol circuit 1114. The control circuit may control the load controlcircuit 1110 based on the zero-cross timing signal provided by thezero-cross detector 1118. For example, the control circuit 1114 maycontrol the load control circuit 1110 to provide a dimmed hot signal onterminal DH, where the dimmed hot signal may use phase angle dimming.The firing time of the load control circuit to provide the desired phaseangle of the dimmed hot signal may be based on the zero-cross signalfrom the zero-cross detector 1118. The load control circuit may be acontrollably conductive device, such as a triac, silicon-controlledrectifier (SCR), field-effect transistor (FET), or the like.

The audio device 1100 may further include a user interface 1116 forcontrolling the electrical load 1104. The user interface 1116 may beelectrically connected to the control circuit 1114, and may include oneor more actuators (on/off, dim, etc.). The control circuit 1114 maycontrol the load control circuit 1110 based on user input received fromthe user interface 1116. For example, a user may actuate an on or offswitch on the user interface 1116 of the audio device 1100, and theaudio device 1100 may control the load 1104 on or off in response toreceiving the user input at the user interface 1116. Additionally, oralternatively, the user input may comprise dimming actuators for dimmingthe load 1004 up and down.

The audio device 1100 may include a second communication circuit 1126.The communication circuit 1126 may be operatively coupled to the controlcircuit 1114. The communication circuit 1126 may be a wireless or awired communication circuit and may receive wireless or wired signalsfrom remote devices, such as a remote which may send load controlcommands to the load control device; a hub; a router; etc. The signalsreceived by the communication circuit 1126 may contain load controlcommands. The control circuit may receive the signals from thecommunication circuit 1126 and may control the load control circuit 1110based on the received signals. Such signals couldalternatively/additionally be received on communication circuit 1124.Alternatively, and/or additionally, the signals received on 1126 may bea privacy setting command from a remote device such as a hub, router,keypad, remote, etc. The control circuit may receive and process theremote privacy command from the communication circuit 1126, and mayfurther determine to put the audio device 1100 into privacy mode asdescribed previously in response to receiving the remote privacycommand. The communication circuit 1126 may communicate via Wi-Fi,Wi-MAX, Bluetooth®, ZigBee®, Z-Wave, Thread, or a proprietary protocol(e.g., the ClearConnect® protocol), etc.

In addition to the embodiments currently described, an audio device mayuse any combination of the disclosed privacy methods. For example, anaudio device may have a privacy or mute cover, as shown in FIG. 2 or 3 ,and may also include a mute button, and/or be controllable from a remotecommand, etc.

FIG. 12 is an example of a remote privacy mode setting made available toa user via a graphical based application from a device such as a mobiledevice 1200, PC, laptop, etc. Alternatively, it may be provided as a webbased application. The remote privacy mode may be for a specific audiodevice or it may be setup as a scene, wherein multiple devices mayrespond to the privacy mode command. In one example, the user may pressa software button on a mobile application on a mobile device, such asmobile device 115 of FIG. 1 , to place one or more of the audio devicesinto privacy mode.

FIG. 12 shows one such example of a mobile device 1200 with variousscene settings. The mobile device may have one or more scene optionsselectable by a user. The scene options may be displayed on a graphicaluser interface (GUI) of a mobile application. The mobile device 1200shows several example scenes that may be available for a user to select.When a user selects a scene, the mobile device may wirelesslycommunicate with a hub device, wherein the hub device may send a scenecommand to the load control devices in the user environment to go to theselected scene. Alternatively, the load control devices may receive thescene command directly from the mobile device. In response to receivingthe scene command, the load control devices may control their respectiveloads. For example, load control devices may turn on electrical lightingor HVAC loads, motorized window treatments may adjust a level of awindow covering, etc., in response to the scene command. In addition,audio devices may determine whether to respond to the scene command toplace the audio device into a privacy mode.

In one example, the mobile application may have an All On scene 1210,which turns on the devices that are part of the All On scene. Forexample, any load control devices located in the user environment mayturn on their respective electrical lighting loads, and/or motorizedwindow treatments may open respective window coverings, etc., inresponse to the “All On” command. The mobile application may have an AllOff scene 1220, which may turn off all the devices that are part of theAll Off scene. For example, any load control devices located in the userenvironment may turn off their respective electrical lighting loads,and/or motorized window treatments may close respective windowcoverings, and/or the HVAC may turn off or go to a setback temperaturein response to the “All Off” command.

Additionally, the mobile device may have a Privacy scene 1230. ThePrivacy scene 1230, when actuated by a user, may send a command to oneor more devices to enable privacy mode. For example, a user may pressthe Privacy button 1230 on the mobile device 115 of FIG. 1 to place theaudio device/load control device 104 into a privacy mode. The mobiledevice 115 may transmit (i.e., wirelessly transmit) the privacy commandeither directly to the audio device, or may transmit to the hub device129 (directly or through the router 127 or Internet server), wherein thehub device 129 may then send the privacy command via a wired or wirelessconnection to the audio devices in the user environment.

Although the audio devices have been described as enabling a privacymode in response to a remote privacy command, the audio devices mayalternatively disable or disengage from the privacy mode in response toa remote command. That is, a command to turn off privacy mode may turnoff privacy mode for one or more audio devices in the user environment.Additionally, although privacy mode has been described for audiodevices, one will understand that other devices which monitor a userenvironment may also have a privacy mode and may additionally beresponsive to the privacy command. For example, devices which recordvideo, such as video intercom 120 and security camera 122, may also havea privacy mode for the video recording. In this example, the privacybutton 1230 may place the audio device/load control device 104, videointercom 120, and security camera 122, each into privacy mode to stoptransmitting data, thereby securing the privacy of the user environment100. For example, the privacy mode may cause each device to ceasetransmitting data to the hub device 129 or the router 127. Additionally,or alternatively, the privacy mode may cause each device to ceasetransmitting data to any other device. For example, the security camera122 may transmit data to a security system. In this case, the privacymode button may be configured to stop the transmission of data from thesecurity camera 122 to the security system. Similar to the privacyairgap switches as described for audio devices, one or more privacyairgap switches may be used for video devices to remotely break anelectrical connection in the video circuit. Or, a control circuit of thevideo devices may stop transmitting or processing the video feed inresponse to receiving a privacy command.

This remote-level privacy mode may allow a user 102 to place a deviceinto privacy mode while the user is not proximate the device, i.e.,while the user is located remotely from the device. The remote-levelprivacy mode may provide a single control point for a user to placemultiple devices within the user environment 100 into a privacy mode.

For example, the remote-level privacy mode may provide a single point ofcontrol for a hotel room, conference room, or a room of a residence.Alternatively, the remote-level privacy mode may be used as a singlecontrol point to place an entire building into privacy mode.

As another example, the remote-level privacy mode may be engaged throughother mechanisms. For example, the remote-level privacy mode may beengaged or entered by any number of triggers, e.g., a button press, avoice command, short-range communication, gesture, or triggered based ona condition. For example, the remote-level privacy mode may be enabledby a button press. In addition to the button press on a mobileapplication previously described, the remote-level privacy mode may beengaged through a button press on keypad 106 of FIG. 1 . Alternatively,the remote-level privacy mode may be engaged through a button or airgapswitch mechanism on the hub device 129. For example, a user may press abutton on keypad 106, or a button or airgap switch on hub device 129, toplace all the audio and/or video devices of room 100 which record andtransmit sensitive data (i.e., audio and/or video feeds) into privacymode.

Alternatively, the remote privacy mode may be remotely enabled via avoice command. For example, a user 102 may speak a voice command, suchas, for example, “privacy mode”. The voice command may be received by anaudio device, such as audio device 104. The audio device may determinewhether the voice command is a privacy command. That is, the voicecommand may act as a keyword, or wake word, which is processed locallyby the control circuit of the audio device. When the audio device 104determines that the voice command is a privacy command, the audio device104 may enable privacy mode. Each of the audio devices in the room 100may be responsive to the privacy command. Alternatively, only the hubdevice 129 may be responsive to the keyword of the voice command toenter privacy mode, and the hub device may send a privacy command to therespective devices in the user environment 100. For example, the hubdevice 129 may be an audio device and may include additional audioprocessing circuitry to allow for multiple keywords, such as privacykeywords. In this way, each audio device in the room may not requireadditional audio processing circuitry. For example, the hub 129 mayreceive the voice command from the user 102 to go into privacy mode, andthe hub 129 may transmit a privacy command to the load control device104, security camera 122, and the video intercom 120 via wirelesssignals 108, for example.

The voice command to trigger privacy mode may be a command setup by auser. Or, the voice command may be based on a specific keyword. Forexample, the privacy mode may be automatically engaged in response tothe detection of specific keywords such as “bank”, “account”, or “pin”are received at an audio device. Privacy mode may also be engaged whennumerical digits are read out loud. In this way, the privacy of verballyspoken credit card, bank account, social security, and/or phone numbersmay be maintained, and not transmitted by the audio device. In additionto any of these words, any keyword may be used to trigger privacy mode.Additionally, the audio device may locally (or through processing on aremote server), determine context along with a trigger word beforeenabling privacy mode. For example, the audio device may look for acombination of keywords such as “bank” and “account”, or “account” and“number” or “pin”.

Privacy mode may also be enabled based on short-range communication froma privacy device. For example, a privacy device may be a remote controlor even the mobile device 115. The privacy device may wirelessly send aprivacy command to the audio device to put the audio device into privacymode. For example, the privacy device may transmit a privacy commandover short-range communication. Short-range communication may be any oneof acoustic, visible light, infrared light, radio-frequency (e.g.,near-field), or any other type of short-range communication. The privacydevice may have a wireless communication circuit and a privacy modebutton for receiving a user input. A user may press the privacy modebutton on the privacy device to transmit a privacy command via thewireless communication circuit to other devices in the space.

Privacy mode may alternatively be enabled or disabled based on a gesturefrom a user. The user may gesture to the audio device or to a privacydevice to put the audio device into privacy mode. Examples ofgesture-based control of devices is described in more detail in U.S.Patent Application Publication No. 2016/0224036, entitled “GESTURE-BASEDLOAD CONTROL VIA WEARABLE DEVICES”, filed Jan. 29, 2016, the entiredisclosure of which is herein incorporated by reference.

Alternatively, privacy mode may be triggered based on a condition. Thecondition may be based on a specific user or activity. For example, acertain user may always want the devices in privacy mode. In this case,the respective devices, or the hub device, may include the appropriatesensors and software to recognize the user and trigger privacy modebased on the user's presence, or an external camera or sensor may beused. For example, privacy mode may be triggered based on voicerecognition, facial recognition, or gait recognition of the user. As anexample, a given room may have a camera configured with a facialrecognition application. The camera may be configured to recognize agiven user or gesture. Upon detecting a given user or gesture, thecamera may send a privacy command. The audio device may enable privacymode based on the privacy command. Examples of user recognition byvisible light sensors is described in more detail in U.S. PatentApplication No. 2017/0171941, entitled “LOAD CONTROL SYSTEM HAVING AVISIBLE LIGHT SENSOR”, filed Dec. 9, 2016, the entire disclosure ofwhich is herein incorporated by reference.

Additionally, privacy mode may also be triggered based on proximity ofwireless beacons specific to a user, such as the user's phone, wearabledevice, or other remote communication device specific to the user. Forexample, the audio device or the hub device 129 may be configured torecognize a given wireless beacon. Upon detecting the beacon, the audiodevice may enter a privacy mode. Or, the hub device 129 may detect thebeacon and send a privacy command to the audio device to go into aprivacy mode. Once the audio device or hub device 129 has stoppeddetecting the beacon, the audio device may disable or disengage theprivacy mode. Examples of user recognition based on beacons is describedin more detail in U.S. Patent Application No. 2016/0056629 filed on Aug.21, 2015, entitled “LOAD CONTROL SYSTEM RESPONSIVE TO LOCATION OF ANOCCUPANT AND MOBILE DEVICES”, the entire disclosure of which is hereinincorporated by reference.

Privacy mode may also be triggered based on any other type of geofencingtechnology present in the user's phone or remote communication device.It is known, for example, to trigger a scene based on geofencing (i.e.,a user has crossed a geofenced area, such as arriving at their home).Home control systems such as Caséta, manufactured by Lutron ElectronicsCo., Inc., have a geofencing feature that turns on a scene based on auser crossing a geofenced area. This could be extended to include aprivacy scene or mode based on geofencing.

Privacy may be triggered based on other conditions, such as a detectedactivity. For example, the privacy mode may be triggered when a userreceives a phone call. The mobile device 115 may detect when a phonecall is received and transmit a command to one or more devices, or thehub device 129, to go into privacy mode. Alternatively, the audiodevices may recognize specific activities and may enable privacy modewhen the specific activity has been detected. For example, the audiodevice 104 may receive an acoustic sound. The audio device 104 mayidentify the acoustic sound as a ringtone, determine that a user isreceiving a phone call, and based on the determination, the audio device104 may enable privacy mode. For example, the remote server 140 maycontinually process audio data and may compare the data to a database ofknown or learned sounds. When the audio device determines that a soundis an incoming phone call, for example, the audio device may enter orenable the privacy mode.

For the remote privacy modes described herein, the privacy mode may beenabled (or disabled) at a device level, room level, or building level,as setup by a user. Additionally, the privacy mode may be enabledindefinitely until a user disables the privacy mode, and vice versa. Forexample, the user may physically disable the privacy mode by any one ofthe following methods: removing a privacy cover; re-engaging a privacyairgap; turning off an interference; etc. For added security, theprivacy mode may need to be physically disabled at the device.

Alternatively, the privacy mode may be disabled remotely through asecure transmission. For example, a user may remotely disable theprivacy mode using a mobile device, such as mobile device 115, that hasa security key to unlock the security mode. In one example, the securitykey may be an optical security key, and the user may optically unlockthe security mode through LiFi. That is, the mobile device may flash asecurity key via the display or the camera flash, which may be receivedby a light detector or sensor of a hub device, such as hub device 129,or other control device, such as the load control 104, to disable theprivacy mode. The security key may be specific to the user 102. Thismethod may be used for disabling the privacy mode as described herein,or for enabling or engaging the privacy mode.

The privacy mode may be used with a timeout counter. For example,privacy mode may be enabled for a finite period of time using thetimeout counter, and when the timeout counter has expired, the audiodevice may exit the privacy mode. For example, the privacy mode may beenabled for an hour-long meeting, and after the hour, the privacy modemay be disabled.

The countdown of the timeout counter may be done by the control circuitof the audio device, or by the hub device 129 which may then send acommand to the audio device at the end of the timeout. The audio device(or the hub device 129) may include a counter, and the control circuitmay use the counter to determine a timeout.

The length of the timeout may be configurable, whereby a user mayinitially setup the audio device with a specific timeout (e.g., onehour), or may add a timeout when enabling the privacy mode. A user mayconfigure the length of the timeout either through an advancedprogramming mode on the audio device, or through a GUI application on amobile device, laptop, PC, etc. Alternatively, a user may vocallycommand the audio device to instruct the privacy timeout length. Forexample, a user may say “Privacy, 10 minutes”, where “privacy” is usedas a keyword to enable privacy mode, and “10 minutes” specifies thelength of the timeout.

As another (or additional) example, the timeout counter may be used todisengage privacy mode. For example, a user may press a button todisengage privacy mode for 10 seconds, to make a request, for example,after which privacy mode is automatically re-enabled. Or, the privacymode may be disengaged the entire time a button is pressed, i.e.,push-to-talk mode. A user may push the button while talking to disengagethe privacy mode and allow the audio device to receive the spokenrequest from the user. When the user stops pressing or pushing thebutton, the audio device may return to privacy mode and stop recordingor listening to acoustic data. For example, the button may be a physicalbutton such as an actuator or capacitive touch area on the audio device,such as the privacy button or privacy switch of FIGS. 5 and 9 . Or, thebutton may be a physical button on a remote device, such as a remote orkeypad. Alternatively, the button may be a soft button on a mobiledevice, laptop, PC, etc.

Alternatively, the privacy mode may be enabled or disabled based on acondition or event. For example, the user environment may contain anoccupancy sensor. The occupancy sensor may be configured to communicatewith the audio device, wherein the audio device may enable or disablethe privacy mode based on an occupancy detection within the room. Theaudio device may also use a timeout counter with the event-based orcondition trigger. For example, the audio device may disable the privacymode for the first 30 seconds after occupancy has been detected in theroom. In this case, occupancy may be sensed by the audio device itself,or may be received by the communication circuit from an occupancy sensoror the hub device 129.

Alternatively, privacy mode may be automatically set for a room, such asa conference room, based on a calendar meetings schedule for that room.For example, a user may book or schedule a conference room for aparticular time period using calendar software (such as MicrosoftOutlook, for example, manufactured by Microsoft Corporation). The usermay indicate in the meeting appointment that the meeting isconfidential, for example, by setting the meeting to private, includingthe words “confidential” or “private” in the meeting subject or body, orusing an additional setting to mark it confidential or indicate that aprivate meeting is desired, etc. Based on the calendar meetingsschedule, privacy mode may then be enabled for the room during the timeperiod when the confidential meeting is scheduled. After the meeting isconcluded, each of the devices in the meeting room may return to theirnormal (i.e., non-privacy mode) states. The end of the meeting may bedetermined based on when the time period of the calendar meeting haspassed. Alternatively, the end of the meeting may be determined by theoccupancy state of the room, i.e., when one or more occupancy sensorsdetect that the room is unoccupied. In a related example, the occupancysensors may be acoustic sensors comprising microphones, where theacoustic sensors monitor sounds in the room to detect when the room isvacant (i.e., when the meeting has ended) but do not transmit acousticdata.

In another example, the privacy mode may be enabled or disabled based onproximity of a user to the device. For example, when a user is within acertain privacy distance of the audio device, the audio device mayengage or disengage a privacy mode. The privacy distance may bespecified by the user or may be set by the audio device or systemcontroller. For example, the privacy distance may be 3 feet. The audiodevice may acoustically measure user proximity using a microphone array,or via a single microphone, beacon technology, or any other knowntechnology in measuring distance between a device and a user.

FIG. 13 is an example method 1300 that may be executed by a controlcircuit of an audio device to enter privacy mode according to any of theembodiments herein. The method may start at step 1310, when the controlcircuit receives a privacy command. As previously described, the privacycommand may be any of: a wireless command (received from a remote buttonpress from a GUI or a detection of occupancy from an occupancy sensor);a detection of occupancy (i.e., from an occupancy sensor integrated withthe audio device); a sound (a specific spoken keyword or a noiseassociated with a specific activity such as a phone ringing); and thelike.

At step 1320, the control circuit may determine, based on the privacycommand, whether or not to enter privacy mode. For example, if thecontrol circuit has received the privacy command, the control circuitmay then send a signal to go into the privacy mode at step 1330. Forexample, the signal may be providing voltage to a reset line of a remotereset switch, such as line 850 of FIG. 8A, to change the state of theremote reset switch to remove power and/or communication to themicrophone, or other portions of the audio device circuitry, forexample. In a second example, the signal to go into privacy mode may bea signal 880′ as shown in FIG. 8B to instruct a separate second controlcircuit 855′ to begin providing noise/interference signals 865′ or 870′.The method may then end.

Alternatively, if the control circuit determines not to enter privacymode at step 1320, (for example, the privacy command received at 1310was a signal that the remote reset switch has manually been returned tothe non-privacy state, or a wireless command to exit privacy mode hasbeen received, or a vacancy command has been received, etc.), the methodmay then proceed to step 1340, where the control circuit may provide asignal to exit the privacy mode. For example, the control circuit maycease providing voltage to the reset line of the remote reset switch. Ina second example, the control circuit may cease signaling the separatesecond control circuit to cause the separate second control circuit tostop providing interference signals to obfuscate the acoustic data. Themethod may then end.

In addition to the embodiments described herein, one skilled in the artwill recognize that any combination of these concepts may readily beapplied to achieve the same effects, all of which are considered to bewithin the scope of this disclosure. For example, although not discussedin detail herein, privacy mode may alternatively be achieved through adedicated privacy link wired throughout the home, i.e., a system ofwired devices which may each go into privacy mode when a wired orwireless privacy command is received. Additionally, although most of thedisclosure has been specific to audio devices for voice applications,one skilled in the art will further recognize that these concepts arenot limited to voice recognition devices, but any audio device whichrecords acoustic data from a space, or other devices such as cameras orvideo recording devices as well.

What is claimed:
 1. An electrical load control apparatus comprising: amicrophone circuit to receive sound and generate acoustic data from thereceived sound; a communication circuit operatively coupled to thecontrol circuit, the communication circuit to transmit the acoustic datato an external device; a control circuit operatively coupled to themicrophone circuit and to the communication circuit, the control circuitselectively transitionable between a FIRST, non-private, operating stateand a SECOND, private, operating state, the control circuit to: receivethe acoustic data from the microphone circuit; receive an instruction inan input signal to reversibly transition the control circuit between theFIRST, non-private, operating state and the SECOND, private, operatingstate; responsive to an instruction in the received input signal totransition the control circuit to the FIRST, non-private, operatingstate: cause the communication circuit to transmit the received acousticdata to the at least one external device; and responsive to aninstruction in the received input signal to transition the controlcircuit to the SECOND, private, operating state: obfuscate the acousticdata received from the microphone circuit; and cause the communicationcircuit to transmit the obfuscated acoustic data to the at least oneexternal device.
 2. The electrical load control apparatus of claim 1,further comprising: a second control circuit communicatively coupled tothe control circuit; wherein to cause the control circuit to obfuscatethe acoustic data received from the microphone circuit, the controlcircuit to: communicate a first output signal to the second controlcircuit; cause the second control circuit to generate an electricalnoise signal responsive to receipt, by the second control signal, of thefirst output signal; receive the electrical noise signal generated bythe second control circuit; mix the electrical noise signal receivedfrom the second control circuit with the acoustic data from themicrophone circuit to produce the obfuscated acoustic data.
 3. Theelectrical load control apparatus of claim 2, the control circuit tofurther: responsive to the instruction in the received input signal totransition the control circuit to the FIRST, non-private, operatingstate: cease transmission of the first output signal to the secondcontrol circuit to halt the generation of the electrical noise output bythe second control circuit.
 4. The electrical load control apparatus ofclaim 1, further comprising: at least one audio output device; and asecond control circuit communicatively coupled to the control circuitand to the at least one audio output device; wherein to cause thecontrol circuit to obfuscate the acoustic data received from themicrophone circuit, the control circuit to: communicate a first outputsignal to the second control circuit; cause the at least one audiooutput device to generate a noise output; wherein the noise outputgenerated by the at least one audio output device combines with soundcollected by the microphone circuit to produce the obfuscated acousticdata.
 5. The electrical load control apparatus of claim 2, the controlcircuit to further: responsive to the instruction in the received inputsignal to transition the control circuit to the FIRST, non-private,operating state: cease transmission of the first output signal to thesecond control circuit to halt the generation of the noise output by theat least one audio output device.
 6. The electrical load controlapparatus of claim 1, the control circuit to further: responsive to theinstruction in the received input signal to transition the controlcircuit to the SECOND, private, operating state: communicate, to asystem controller, a notification message that includes informationindicative of the transition of the control circuit to the SECOND,private, operating state.
 7. The electrical load control apparatus ofclaim 1, further comprising: at least one manually actuated input deviceoperatively coupled to the control circuit; wherein to receive theinstruction in the input signal to reversibly transition the controlcircuit between the FIRST, non-private, operating state and the SECOND,private, operating state, the control circuit to; receive, via anactuation of the at least one manually actuated input device, theinstruction to reversibly transition the control circuit between theFIRST, non-private, operating state and the SECOND, private, operatingstate.
 8. The electrical load control apparatus of claim 1, thecommunication circuit to further: receive a wireless input signal from acontrol device; wherein to receive the instruction in the input signalto reversibly transition the control circuit between the FIRST,non-private, operating state and the SECOND, private, operating state,the control circuit to: receive, via the communication circuit, thewireless input signal that includes the instruction to reversiblytransition the control circuit between the FIRST, non-private, operatingstate and the SECOND, private, operating state.
 9. An electrical loadcontrol method, comprising: receiving, by a control circuit, acousticdata generated by a microphone circuit using sounds detected by themicrophone circuit; receiving, by the control circuit, an input signalto reversibly transition the control circuit between a FIRST,non-private, operating state and a SECOND, private, operating state;responsive an instruction in the received input signal to transition thecontrol circuit to the FIRST, non-private, operating state: causing acommunicatively coupled communication circuit to transmit the acousticdata received from the microphone circuit to at least one externaldevice; and responsive an instruction in the received input signal totransition the control circuit to the SECOND, private, operating state:obfuscating, by the control circuit, the acoustic data received from themicrophone circuit; and causing, by the control circuit, thecommunication circuit to transmit the obfuscated acoustic data to the atleast one external device.
 10. The method of claim 9 wherein obfuscatingthe acoustic data received from the microphone circuit furthercomprises: communicating, by the control circuit, a first output signalto a communicatively coupled second control circuit; causing, the secondcontrol circuit to generate an electrical noise signal responsive toreceipt of the first output signal by the second control circuit;receiving, by the control circuit, the electrical noise signal generatedby the second control circuit; and mixing, by the control circuit, theelectrical noise signal received from the second control circuit withthe acoustic data received from the microphone circuit to produce theobfuscated acoustic data.
 11. The method of claim 10, furthercomprising, responsive to receipt of the instruction in the receivedinput signal to transition the control circuit to the FIRST,non-private, operating state: ceasing, by the control circuit,transmission of the first output signal to the second control circuit tohalt the generation of the electrical noise output by the second controlcircuit; and receiving, by the control circuit, at least one instructionfrom the at least one external device, responsive to causing thecommunicatively coupled communication circuit to transmit the acousticdata received from the microphone circuit to the at least one externaldevice.
 12. The method of claim 9 wherein obfuscating the acoustic datareceived from the microphone circuit further comprises: communicating,by the control circuit, a first output signal to a communicativelycoupled second control circuit; and causing an audio output deviceoperatively coupled to the second control circuit to generate a noiseoutput responsive to the receipt of the first output signal by thesecond control circuit; wherein the noise output generated by the audiooutput device combines with sound collected by the microphone circuit toproduce the obfuscated acoustic data.
 13. The method of claim 10 furthercomprising, responsive the instruction in the received input signal totransition the control circuit to the FIRST, non-private, operatingstate: ceasing, by the control circuit, transmission of the first outputsignal to the second control circuit to halt the generation of the noiseoutput by the at least one audio output device.
 14. The method of claim9, further comprising, responsive to the instruction in the receivedinput signal to transition the control circuit to the SECOND, private,operating state: communicating, by the control circuit, a notificationmessage that includes information indicative of the transition of thecontrol circuit to the SECOND, private, operating state to a systemcontroller.
 15. The method of claim 9, further comprising, responsive tothe instruction in the received input signal to transition the controlcircuit between the FIRST, non-private, operating state and the SECOND,private, operating state: receiving, via an actuation of at least oneoperatively coupled input device, an input signal that includes theinstruction to reversibly transition the control circuit between theFIRST, non-private, operating state or the SECOND, private, operatingstate.
 16. The method of claim 9, further comprising, responsive to theinstruction in the received input signal to transition the controlcircuit between the FIRST, non-private, operating state and the SECOND,private, operating state: receiving, via the communication circuit, awireless input signal that includes the instruction to reversiblytransition the control circuit between the FIRST, non-private, operatingstate or the SECOND, private, operating state.
 17. A non-transitory,machine-readable, storage device that includes instructions that, whenexecuted by a control circuit in an electrical load control apparatus,causes the control circuit to: receive acoustic data generated by anoperatively coupled microphone circuit, the acoustic data based onsounds sensed by the microphone circuit; receive an instruction in aninput signal to reversibly transition the control circuit between aFIRST, non-private, operating state or a SECOND, private, operatingstate; responsive to the instruction in the received input signal totransition the control circuit to the FIRST, non-private, operatingstate: cause a communicatively coupled communication circuit to transmitthe acoustic data received from the microphone circuit to at least oneexternal device; and responsive to the instruction in the received inputsignal to transition the control circuit to the SECOND, private,operating state: obfuscate the acoustic data received from themicrophone circuit; and cause the communication circuit to transmit theobfuscated acoustic data to the at least one external device.
 18. Thenon-transitory, machine-readable, storage device of claim 17 wherein theinstruction that causes the control circuit to obfuscate the acousticdata received from the microphone circuit further causes the controlcircuit to: communicate a first output signal to a communicativelycoupled second control circuit; cause the second control circuit togenerate an electrical noise signal responsive to receipt of the firstoutput signal by the second control circuit; receive the electricalnoise signal generated by the second control circuit; and mix theelectrical noise signal received from the second control circuit withthe acoustic data from the microphone circuit to produce the obfuscatedacoustic data.
 19. The non-transitory, machine-readable, storage deviceof claim 18 wherein the instructions, when executed by the controlcircuit, further cause the control circuit to: responsive to theinstruction in the received input signal to transition the controlcircuit to the FIRST, non-private, operating state: cease communicationof the first output signal to stop the obfuscation; and receive at leastone instruction from the at least one external device, responsive tocausing the communicatively coupled communication circuit to transmitthe acoustic data received from the microphone circuit to the at leastone external device.
 20. The non-transitory, machine-readable, storagedevice of claim 17 wherein the instructions that cause the controlcircuit to obfuscate the acoustic data received from the microphonecircuit, further cause the control circuit to: communicate a firstoutput signal to a communicatively coupled second control circuit; andcause at least one audio output device operatively coupled to the secondcontrol circuit to generate a noise output responsive to the receipt ofthe first output signal by the second control circuit; wherein the noiseoutput generated by the at least one audio output device combines withsound collected by the microphone circuit to produce the obfuscatedacoustic data.
 21. The non-transitory, machine-readable, storage deviceof claim 17 wherein the instructions, when executed by the controlcircuit, cause the control circuit to: responsive to the instruction inthe received input signal to transition the control circuit to theFIRST, non-private, operating state: cease transmission of the firstoutput signal to the second control circuit to halt the generation ofthe noise output by the at least one audio output device.
 22. Thenon-transitory, machine-readable, storage device of claim 17 wherein theinstructions, when executed by the control circuit, cause the controlcircuit to: responsive to the instruction in the received input signalto transition the control circuit to the SECOND, private, operatingstate: communicate a notification signal that includes informationindicative the transition of the control circuit in the SECOND, private,operating state to a system controller.
 23. The non-transitory,machine-readable, storage device of claim 17 wherein the instructions,when executed by the control circuit, cause the control circuit to:responsive to the instruction in the received input signal to transitionthe control circuit between the FIRST, non-private, operating state andthe SECOND, private, operating state: receive the input signal totransition the control circuit from at least one manually actuated inputdevice operatively coupled to the control circuit.
 24. Thenon-transitory, machine-readable, storage device of claim 17 wherein theinstructions, when executed by the control circuit, cause the controlcircuit to: responsive to the instruction in the received input signalto transition the control circuit between the FIRST, non-private,operating state and the SECOND, private, operating state: receive, viathe communication circuit, a wireless input signal generated by acontrol device.